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At low temperatures the configurational phase space of a macroscopic complex system (e.g., a 
spin-glass) of A'^ ~ 10^^ interacting particles may split into an exponential number Q,a ~ exp(const x 
^— ■»j I A'') of ergodic sub-spaces (thermodynamic states). Previous theoretical studies assumed that the 

, equilibrium collective behavior of such a system is determined by its ground thermodynamic states 

of the minimal free-energy density, and that the equilibrium free energies follow the distribution 
' of exponential decay. Here we show that these assumptions are not necessarily valid. For some 

complex systems, the equilibrium free-energy values may follow a Gaussian distribution within an 
intermediate temperature range, and consequently their equilibrium properties are contributed by 
' excited thermodynamic states. This work will help improving our understanding of the equilibrium 

statistical mechanics of spin-glasses and other complex systems. 
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I. INTRODUCTION 



A thermodynamic system contains a huge number N of interacting particles, with N typically in the order of 
T • 10^^ or larger. The microscopic configurations of such a system changes with time in a complicated and stochastic 
^ \ manner under the joint action of internal forces and perturbations from the environment. At the macroscopic level 
g . the collective properties of the system are, on the other hand, essentially time-invariant and can be described by only 
^ ■ a few phenomenological parameters such as the mean energy density and the specific heat. Nevertheless, at certain 
I— values of the temperature T or other environmental control parameters, the macroscopic behavior of the system may 
also change abruptly and qualitatively. Such phase-transition phenomena, being a major research branch of statistical 
^ mechanics for many years, are deeply connected with the break down of the ergodicity property of the system [1,, 2]. 

For a large class of complex systems with quenched disorder (heterogeneity) and frustrations in the interactions 
\Q among particles as best represented by spin-glasses ^ , when ergodicity breaks down, exponentially many thermody- 
. namic states will form, each of which corresponds to one ergodic sub-space of the whole configurational space of the 
^— I ' system Q. For these systems, it is widely believed (see, e.g., Refs. 0, H, [E 13) that, the equilibrium properties of 
. the system are determined by the ground thermodynamic states which have the global minimal free-energy density 
T-H ' /mill, and the distribution of equilibrium free-energies follows an exponential law. The excited thermodynamic states 
, of free-energy densities / > /min are regarded as irrelevant as long as equilibrium properties are concerned, although 
they dominate the out-of-equilibrium dyiiamics of the system (see, e.g., [13, El)- For example, a disordered 

p-spin interaction Ising model [p > 3) pl^ . [l3j is known to have an ergodic-non-ergodic transition at a temperature 
Td (the so-called dynamic transition temperature), but it is expected that the equilibrium spin-glass phase transition 
will occur only at a lower temperature Tg (the static transition temperature). For > T > Tg, although there 
are exponentially many thermodynamic states, all the relevant configurations for the equilibrium properties are still 
assumed to reside in the same ergodic sub-space of the whole configuration space. 

In this paper, however, we argue that these statements may not necessarily be correct. Through a general theoretical 
analysis, we show that the equilibrium free-energy densities of an ergodicity-broken system may actually follow a 
Gaussian distribution with a mean value larger than /min- Then the equilibrium behavior of the system will be 
determined by a group of excited thermodynamic states rather than by the ground thermodynamic states. Our 
statement is further supported by analytical and simulation results on an exactly solvable model system. This work 
clarifies that, the excited thermodynamic states of a system of broken ergodicity are important not only to the 
dynamical (non-equilibrium) properties of the system but also to its equilibrium properties. The theoretical analysis 
of this paper may help us to understand more deeply the equilibrium (static) properties of spin-glasses and other 
complex systems. 

When the equilibrium free-energies of an ergodicity-broken system follows a Gaussian distribution, the ground 
thermodynamic states of the system may not be reached by any dynamical process, no matter how long one waits or 
which specific cooling schedule is used. In other words, equilibrium studies based on the Gibbs measure will give a 
dynamics-independent lower-bound on the reachably free-energy density. We hope this work will shed light on further 



studies of various fascinating dynamic behaviors of complex systems 
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II. GENERAL THEORETICAL ANALYSIS 



The configuration of a general classical system of N particles can be denoted by a = {cti, (72, • • • , ctn}, where the 
configurational variable ai of a particle need not to be discrete or be scalar. Each configuration has an energy Ti^a). 
Starting from an initial configuration, the system evolves with time and forms a stochastic trajectory in the whole 
configurational space T of the system. At sufficiently high temperatures the system is ergodic and its trajectory will 
visit all the (relevant) configurations in F if waited long enough. More precisely we say a system is ergodic if two 
trajectories evolved from a pair of randomly chosen initial configurations will, with probability unity, intersect with 
each other. In this ergodic situation the total partition function of the system is expressed as 

Z(/3) = 5]exp(-/3H(a)) , (1) 
ffer 

where f3 = 1/T is the inverse temperature. When the system reaches equilibrium, its free energy is minimized, but 
its total internal energy still fluctuate with time. If many measurements are performed on the internal energy, one 
will realize that the measured energy values follows a Gaussian distribution [l], [3] 



where (E) and Ce{I3) are, respectively, the mean total energy and the specific heat of the system. Both (E) and 
CE{f3) are proportional to N. 

At low temperatures, however, ergodicity may no longer hold. As the environmental perturbations become weak, 
the system may be impossible to overcome the large free energy barriers between different regions of the configurational 
space F; it is then trapped in one of many ergodic sub-spaces F^ of F. In this ergodicity-broken case, a sub-space Fq 
is referred to as a thermodynamic state of the system, which has an equilibrium free energy Fa as given by 

Fa{(3) = -r' log(j2 ff6r„e-''«(-)) . (3) 

The energy distribution Eq. ([2]) still holds in each thermodynamic state a, but now both (E) and Ce{P) are thermo- 
dynamic state a-dependent. 

When there are more than one thermodynamic state, the total partition function Eq. ([T]) can be re-expressed as a 
summation over all the thermodynamic states, 

Z[P) = Y,c.eM-PFo.{P)) . (4) 

with each thermodynamic state a contributing a term exp(— /Ji^a). Equation ([4]) contains all the information about 
the equilibrium properties of an ergodicity-broken system. It has the same form as Eq. ([T]), but with the configurations 
tJ being replaced by the thermodynamic states a. This equation indicates that the contribution of a thermodynamic 
state a to the equilibrium property of the system is proportional to exp(— /3Fq,(/3)). Although such a Gibbs measure 
is arguably not holding in an out-of-equilibrium dynamics, it is commonly used in equilibrium studies. In this work 
we also stick to this Gibbs measure. 

To further understand this Gibbs measure, in this paragraph we try to give an interpretation based on a gedankcn 
dynamical process of heating and annealing (but we emphasize that the results of this paper is independent of this 
interpretation). For the system to escape a thermodynamic state a, a large external perturbation has to be applied. 
This might be achieved by first heating the system and then cooling it [l^, [l^ . As the system is heated to a high 
temperature, it becomes ergodic and memory about its prior history is lost. After the system is cooled down slowly 
to its original low temperature, it may reach a different thermodynamic state a' at the end of this process. (During 
the annealing process of this gedanken experiment, the system may be driven by a global and parallel dynamical 
rule.) All the thermodynamic states of the system at a low temperature T will therefore be explored if one repeats 
extremely many times this heating-annealing experiment. With this external assistance, the system again becomes 
ergodic at the level of thermodynamic states. Since the prior history of the system is completely destroyed in the 
heating-annealing experiment, the frequency of the system reaching a thermodynamic state a supposed to be given 
by the Gibbs measure e~'^^°/Z(/3). 

Let us denote by ^ls{F) the total number of thermodynamic states in the system with free energy F . Then the 
equilibrium free energy distribution is governed by 

P{F) cx n^{F)e-f'^ = ex.^{-pF + S,{F)) , (5) 
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where, Ss{F) = logris(^) is the entropy at the level of thermodynamic states. Ss{F) is a concave and increasing 
function of F. We are interested in systems with exponentially many thermodynamic states, i.e., systems with Ss{F) 
being proportional to the size N in leading order. 

If at the minimal free energy Fmin(/3), the first derivative of Ss{F) is greater than /3, i.e., ^^(Fmin) > /3, there exists 
a free energy value F = F > i^min(/3) such that S!.{F) = [3. At the vicinity of F, the entropy Ss{F) is expressed as 

S,{F)^S,{F)^[i{F-F)~,^£^^{F~FY . (6) 

After inserting Eq. ^ into Eq. ([5]) we find that, at equilibrium, the probability of being in a state of free energy F 
is governed by the following Gaussian distribution 



^(^) = WTT^exp U-f— (F-F)M . (7) 



From Eq. ^ it is clear that F is the mean free energy value of the equilibrium thermodynamic states, and Cpifi) oc N 
characterizes the fluctuation of the equilibrium free energies. Since F{P) > -Fmin(/3), we conclude that the equilibrium 
properties of the system at inverse temperature (3 are determined by those excited thermodynamic states whose 
free energy density f{/3) — F/N is larger than the minimal free energy density fmmiP) — F^nin/N. The ground 
thermodynamic states of free energy density fmm{P) actually do not contribute to the equilibrium properties of the 
system. 

On the other hand, if the entropy Ss{F) has the property that at -P'min(/3) its first derivative is less than /3, i.e., 

^'(i^min) = Xl3 (8) 

with < a; < 1, then Eq. ([5]) suggests that the equilibrium free energies will follow an exponential low: 

P{F) oc e-/'(i-)(^-^™('3)) , F > F^M ■ (9) 

Consequently, the equilibrium properties of the system will be contributed by the ground thermodynamic states of 
free energy density /min(/3); and the fluctuation of the observed free energies is only of order unity. 



III. GRAND FREE ENERGY 



To treat the two free-energy distributions of the preceding section with the same mathematical framework, we 
need to define a grand free energy for the system. Following the work of Mezard, Parisi, and Zecchina [13, Ug] on 
the mean-field theory of T = spin-glasses, we can decouple microscopic configurations and macroscopic states by 
introdu cing an artificial inverse temperature y at the level of thermodynamic states. The system's grand free energy 
G{P; y) is defined by 

G(/3;2/) ^ -y-ilog(^„e-^^-(^)) (10) 
= ^y-'log[J d/e^M-^^)] . (11) 
In the thermodynamic limit of A'' — !■ oo, the grand free energy density is 

In Eq. pT|) . S(/) = Ss{Nf)/N measures the entropy density at the level of thermodynamic states; it is called the 
complexity of the system at free energy density / [l8|. The adjustable parameter y controls which thermodynamic 
states will contribute to the grand free energy G(/3; y). Equation pT|) indicates that, when the re-weighting parameter 
y is not too large, the grand free energy is contributed by the excited thermodynamic states of free energy density 
satisfying S'(/) ~ y. The relevant free energy density and complexity are related to the grand free energy density by 

my) = '-^, (13) 
my) = y^'-^>o. (14) 

dy 
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On the other hand, when y > y*{(3) = S'(/min(/3)) , the grand free energy is contributed by the ground thermodynamic 
states of the system, therefore 

/(/3;2/>2/*(/3)) = UUP) (15) 
E(/3;y>y*(/3)) = (16) 

From Eq. pi]) and pB]) we know that, (1) the minimal free energy density /min(/3) corresponds to y = y*{l3), where 
the complexity y) drops to zero; (2) if E(/3; 0) > 0, then /(/3; /3) > fmin{0) is the mean free energy density of the 
thermodynamic states which dominate the equilibrium properties of the system. 



IV. RESULTS ON THE p-SPIN INTERACTION ISING SPIN-GLASS MODEL 



Let us complement the above-described general analysis with a concrete example, namely the p-spin interaction 
Ising model on a complete graph [l^. The Hamiltonian of the model is 



n{a) 



E 



J, 



(17) 



l<ii<...<ir,<N 



where the spin variables (Ji — ±1 and the quenched (time-independent) coupling constant Ji-^...ip is identically and 
independently distributed according to 



' NP- 



exp 



p}j2 '^tlt2---tp 



(18) 



with J being a constant parameter (the energy unity of the system). For p = 2, Eq. (|17p is the celebrated Sherrington- 
Kirkpatrick model [1, For p > 3, earlier efforts (sj, have found that the system has two transitions, a 

dynamic transition followed by a lower-temperature static transition. The dynamic transition is related to the onset 
of ergodicity-breaking and is important for out-of-equilibrium processes, but it was not regarded as a real equilibrium 
phase-transition. 

If we assume that all the thermodynamic states of the model system Eq. (I17|) are evenly distributed in the whole 
configurational space F, i.e., there is no further clustering of the thermodynamic states, the grand free-energy density 
of the system as defined by Eq. (|12p can be obtained through the cavity method [J] (see also [lal)- The final expression 
for g{(3; y) is 



my) 

1 



log 2 



p-l 
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X cosh^/'^(/3JAozo + /3JAizi) 



J'{yq'o + if3~y)q'i) 



^° los 



dzi 



(19) 



where Aq = ^/PQo' '^''^^i ~ y/pili ^ ^ Qo ^)^^^: 1o = and q\ ~ (m^), with m being the magnetization of a 

vertex in one thermodynamic state, and (• • •) means averaging over all the thermodynamics states a of the system 



(each of them is weighted with the factor 



). and satisfy dg/dq^ = dg/dqi = 0. Equation 



n was first 

derived in [lj| using the replica trick, and was regarded as the free-energy density of the system [l2|, [l^. But we 
see that actually g{P] y) is the grand free-energy density, which combines both the free energy effect and the entropy 
effect (at the level of thermodynamic states) of the system. 

For an infinite system with p = 3, the mean values of the equilibrium and the minimal free energy density are shown 
in Fig. [l]as a function of the inverse temperature /?. Ergodicity of the system breaks down at j3i ~ 1.468, where the 
whole configuration space splits into exponentially many ergodic sub-spaces. The equilibrium and the minimal free 
energy density of the system has a jump at /3i, but the energy and grand free-energy densities are both continuous at 
this point. For (3i < P < P2 — 1.5352, the mean equilibrium free-energy density is higher than the minimal free-energy 
density (which is obtained by setting y > (3), and the complexity of the system decreases continuously with (3 and 
drops to zero at ^2- For (3 > f32, the mean equilibrium free-energy density is identical to the minimal free energy 
density of the system. The above-mentioned results also hold when one considers the possibility of further clustering 
of the thermodynamic states or splitting of each thermodynamic state into sub-states 13, 20i]. 
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Inverse Temperature P 



FIG. 1: The mean equilibrium free energy density and the minimal free energy density of the 3-spin interaction Ising model 
Eq. (I17|l on a complete graph of TV = oo. Inset shows the complexity E(/3;/3) as a function of /3. For P G (1.468, 1.5352) the 
equilibrium properties of the system are determined by excited thermodynamic states. 

For a system with small size TV ergodicity will be preserved even at low temperatures; but the relevant configurations 
of the system may show some degree of clustering. To detect this organization, we can calculate the overlaps between 
the sampled independent configurations of the system. The overlap of two configurations and is defined as [3] 

1 ^ 

Ai2 = ]^E-M- (20) 

The overlap histograms for two finite systems of sizes N — 100 and N — 200 are shown in Fig. [2] Two peaks appear 
in the histograms when (3 approaches the theoretically predicted value (3i. The peak at A ~ is due to pairs of 
configurations from different domains of the configurational space, and the other peak at A ~ 0.8 (for N = 100) 
or A ~ 0.6 — 0.8 (for N = 200) corresponds to the overlaps between configurations from the same domain of the 
configurational space. Figure [2] also demonstrates that, as the system size N increases, the organization of the 
configurational phase space becomes more complex. 



V. CONCLUSION AND DISCUSSION 



In this paper we studied the equilibrium properties of a thermodynamic system with broken ergodicity such as 
a spin-glass. If the number of thermodynamic states increases exponentially fast with the system size TV at low 
temperatures, we show that the equilibrium free-energy distribution of the system may be Gaussian, and consequently 
the equilibrium static properties of the system are determined by excited thermodynamic states of the system, whose 
free-energy densities are higher than the minimal free-energy density of the system. A grand free energy function 
(with an adjustable parameter y) was defined in this paper following the earlier work of Refs. [itIITH to calculate the 
mean value of the equilibrium free-energy density and the complexity of the system. 
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Overlap 

FIG. 2: Overlap histograms for a 3-spin interaction Ising systems of A'^ = 200 vertices (the main figure) and A'' = 100 vertices 
(the inset). Different curves correspond to different inverse temperatures. 

The mean- field theory of spin-glasses by Parisi and colleagues ^ Q was based on the assumption that the equilibrium 
free-energies of the system obey an exponential distribution. Under that theory, only the thermodynamic states of 
the ground free-energy density are allowed to contribute to the equilibrium properties of the system. As we now 
know, for disordered systems with two-body interactions this assumption of exponential-distribution is valid. 
But for a system with many-body interactions, there may exist a temperature window within which the free-energy 
distribution is Gaussian. In this later case. Fig. [1] demonstrates that the mean value of the equilibrium free-energy 
densities decreases with temperature. This apparently will cause an entropy crisis, but actually the entropy of a 
thermodynamic state is positive. Notice that when the free-energy distribution is Gaussian, different groups of 
thermodynamic states are taking the dominant role as the temperature changes. The predictions of the present work 
can be further checked by Monte Carlo simulations on a large finite-connectivity complex system with many-body 
interactions. 

In this work, we focused on the equilibrium statical properties of an ergodicity-broken system and assumed that 
the significance of each thermodynamic state a is proportional to exp(— /3Fq), with Fa being its free energy. This 
assumption may not be valid for out-of-equilibrium dynamical processes. For these later non-equilibrium processes, it 
has been suggested that the system will typically be trapped to a free energy level which corresponds to the maximal 
complexity. When the system is cooled down slowly from a high temperature, the reachable thermodynamic states 
depend strongly on the specific dynamical rules used (lol . [ll| . The mean equilibrium free energy density discussed 
in this paper, although may not being achievable in a dynamical experiment, sets a lower-bound on the dynamically 
reachable free energy density. As demonstrated by Fig. [TJ in an intermediate temperature range, this lower bound 
may be well above the minimal free energy density of the system. 
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